feat(optimizer): Implement LIKE expression rule for query optimization#96
Open
loloxwg wants to merge 10 commits intoKipData:mainfrom
Open
feat(optimizer): Implement LIKE expression rule for query optimization#96loloxwg wants to merge 10 commits intoKipData:mainfrom
loloxwg wants to merge 10 commits intoKipData:mainfrom
Conversation
The commit introduces a new rule for the optimization of LIKE operator in SQL queries. The LIKE operator expressions are rewritten to make use of binary operators such as GtEq and Lt in certain cases which enhances the performance of queries. Additionally, new tests for incremented character rule have been added, and `LikeRewrite` has been added to optimizer rules in the rule set.
loloxwg
changed the title
KKould
reviewed
Nov 12, 2023
KKould
reviewed
Nov 12, 2023
KKould
reviewed
Nov 12, 2023
KKould
reviewed
Nov 12, 2023
src/optimizer/rule/simplification.rs
Outdated
| { | ||
| // if left is column and right is constant | ||
| if let ScalarExpression::ColumnRef(_) = left_expr.as_ref() { | ||
| if let ScalarExpression::Constant(value) = right_expr.as_ref() { |
Member
There was a problem hiding this comment.
reduce unnecessary nesting and matching
if let ScalarExpression::Constant(DataValue::Utf8(mut val)) = right_expr.as_ref() {
KKould
reviewed
Nov 12, 2023
Member
|
It looks good, but it lacks the test of the rules. Reference: https://github.com/KipData/KipSQL/blob/main/src/optimizer/rule/column_pruning.rs#L166 |
KKould
reviewed
Dec 25, 2023
| } | ||
|
|
||
| fn apply(&self, node_id: HepNodeId, graph: &mut HepGraph) -> Result<(), OptimizerError> { | ||
| if let Operator::Filter(mut filter_op) = graph.operator(node_id).clone() { |
Member
There was a problem hiding this comment.
Use the operator_mut method to modify directly instead of replace
KKould
reviewed
Dec 25, 2023
| ty, | ||
| } = filter_op.predicate.clone() | ||
| { | ||
| if let ScalarExpression::Constant(value) = right_expr.as_ref() { |
Member
There was a problem hiding this comment.
if let ScalarExpression::Constant(DataValue::Utf8(Some(value))) = right_expr.as_mut()
Instead of pattern matching layer by layer again
KKould
reviewed
Dec 25, 2023
| ty: LogicalType, | ||
| filter_op: &mut FilterOperator, | ||
| ) { | ||
| value_str.map(|value_str| { |
Member
There was a problem hiding this comment.
Method encapsulation of little significance, just to collapse the nesting
KKould
reviewed
Dec 25, 2023
| ) { | ||
| value_str.map(|value_str| { | ||
| if value_str.ends_with('%') { | ||
| let left_bound = value_str.trim_end_matches('%'); |
Member
There was a problem hiding this comment.
if let Some(right_bound) = increment_last_char(left_bound) {
filter_op.predicate = Self::create_new_expr(
&mut left_expr.clone(),
ty,
left_bound.to_string(),
right_bound,
);
}
KKould
reviewed
Dec 25, 2023
| left_bound: String, | ||
| right_bound: String, | ||
| ) -> ScalarExpression { | ||
| let new_expr = ScalarExpression::Binary { |
Member
There was a problem hiding this comment.
Meaningless variable declaration -> new_expr
KKould
reviewed
Dec 25, 2023
|
|
||
| #[test] | ||
| fn test_increment_char() { | ||
| assert_eq!(increment_last_char("abc"), Some("abd".to_string())); |
Member
There was a problem hiding this comment.
There are too few test cases and there is no test carry situation
KKould
reviewed
Dec 25, 2023
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The commit introduces a new rule for the optimization of LIKE operator in SQL queries. The LIKE operator expressions are rewritten to make use of binary operators such as GtEq and Lt in certain cases which enhances the performance of queries. Additionally, new tests for incremented character rule have been added, and
LikeRewritehas been added to optimizer rules in the rule set.What problem does this PR solve?
Add corresponding issue link with summary if exists -->
Issue link:
What is changed and how it works?
Code changes
Check List
Tests
Side effects
Note for reviewer